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Abstract 

We analyze the microscopic evolution of a system undergoing a far-from- 
equilibrium thermodynamic process. Explicitly accounting for the degrees of 
freedom of participating heat reservoirs, we derive a hybrid result, similar in 
form to both the fluctuation theorem, and a statement of detailed balance. 
We relate this result to the steady-state fluctuation theorem, and to a free 
energy relation valid far from equilibrium. 
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I. INTRODUCTION 



The fluctuation theorem refers collectively to a number of theoretical results in the field 
of nonequilibrium statistical mechanics, which are striking because they are valid far from 
thermal equilibrium. Following the original numerical discovery by Evans, Cohen, and 
Morriss 0, a transient fluctuation theorem (applicable to systems driven away from an initial 
state of equilibrium), and a steady-state fluctuation theorem (for systems in a nonequilibrium 
steady state), were derived by Evans and Searles @, and by Gallavotti and Cohen ||, 
respectively, for systems evolving under deterministic but non-Hamiltonian equations of 
motion. These results have stimulated considerable research |§-[19j , in which the fluctuation 
theorem has been generalized (in particular to stochastic evolution) and related to linear 
response theory, specific examples have been studied, and the relation between the transient 
and steady-state fluctuation theorems has been discussed. 

The steady-state version of the fluctuation theorem can be written as: 

r-»oo T p T {-a) k B 

where k B is the Boltzmann constant, and p T (a) is the probability distribution of observing 
an average entropy production rate a over a time interval of length r. The distribution is 
defined with respect to an ensemble of trajectory segments of duration r, sampled while the 
system in question evolves in a nonequilibrium steady state. 

Physically, maintaining a system in a nonequilibrium steady state requires the partici- 
pation of one or more heat reservoirs, for instance to absorb the heat generated by shear 
forces, or to maintain boundaries of the system at different temperatures. Derivations of the 
fluctuation theorem which have appeared in the literature (whether pertaining to systems 
driven away from equilibrium, or to those in a nonequilbrium steady state) have discussed a 
variety of thermostating schemes, both deterministic and stochastic |15|-[19| , to model 

the presence of reservoirs. Many of these schemes originated as numerical strategies for 
simulating the microscopic evolution of a system in thermal contact with a heat reservoir, 
without simulating the huge number of degrees of freedom making up the reservoir itself. 
The very fact that the fluctuation theorem seems to be independent of the thermostating 
scheme lends it considerable support. Indeed, Maes |19| has argued on quite general grounds 
that the fluctuation theorem can be understood as a Gibbs property of space-time histories; 
see also Ref. |20| for illustrative examples. 

Recently, Crooks [TS[] has shown that the fluctuation theorem is closely related to another 
set of results pl|-p7[| - also valid far from equilibrium - which relate the free energy difference 
between two equilibrium states of a system, to the external work performed on the system 
during a nonequilibrium process from one state to the other. 

The purpose of the present paper is to derive a result similar to the fluctuation theorem, 
by explicitly including the degrees of freedom of heat reservoirs in the analysis, and assuming 
Hamiltonian evolution at the microscopic level. This approach corresponds closely to the 
situation present in a laboratory experiment, where the "thermostating" is precisely the 
result of interactions between the system and the innumerable degrees of freedom which 
constitute its environment. We will argue that, when all microscopic degrees of freedom are 
taken into account, then there emerges a "detailed fluctuation theorem" (Eq.[| below), valid 
for finite times r, and expressed without reference to steady states. 
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A Hamiltonian treatment of nonequilibrium processes, similar in spirit to that taken here, 
was carried out by Bochkov and Kuzovlev |28|j29|| (though with less emphasis on a distinction 
between the "system of interest" and its "environment"). The central result derived below, 
however, is new, as is the connection to the fluctuation theorem. More recently, Eckmann, 
Pillet, and Rey-Bellet 
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have introduced and studied an exactly solvable, Hamiltonian 
model of a system (a chain of nonlinear oscillators) coupled to two heat reservoirs at different 
temperatures. It would be very interesting to establish the precise relation between the 
results which they obtain for their model - especially in connection with the nonequilibrium 
steady state - and the approach taken in Section [TV] of the present paper. 

In the following two sections, the central result is stated and derived. While this result 
does not explicitly refer to a nonequilibrium steady state, we argue in Section |V| that, under 
appropriate circumstances, it leads to the steady-state fluctuation theorem. In Section [V] 
we show that the nonequilibrium free energy relation of Refs. pl-27| also follows from the 
central result of the present paper. We end with a discussion in Section |VI|. 



II. STATEMENT OF CENTRAL RESULT 

Suppose we have the following ingredients at our disposal: 

1. a finite, classical system of interest, ip, 

2. a number of heat reservoirs, 6\, 82, ■ ■ ■ , On, 

3. and, possibly, a work parameter, A. 

The work parameter is some degree of freedom which we control externally, for instance 
an external field, and which interacts directly with ip (but not with the reservoirs). The 
reservoirs are also finite, classical systems, prepared ahead of time at various temperatures. 
We suppose that we can establish or break thermal contact between our system of interest 
and any of the reservoirs, as we choose. Finally, we assume that, at the most fundamental 
level of description, the system and reservoirs are composed of a large number of microscopic 
degrees of freedom, and that the collection of these obeys Hamiltonian evolution. 

Our ability to directly manipulate A, and to make or break contact with the reservoirs, 
allows us to subject our system of interest to a variety of thermodynamic processes. We will 
take the word process to be synonymous with an explicit prescription spelling out "what 
we do to the system" at the macroscopic level, using the tools at our disposal (the work 
parameter and heat reservoirs). More precisely, a process n is defined by a set of instructions 
specifying: 

1. the temperatures (7\, ■ ■ • , T/v) at which to prepare the reservoirs, 

2. when to establish and/or break thermal contact between ip and any of the #'s, and 

3. the time- dependence of the work parameter, X(t). 

We will refer to items 2 and 3 as the protocol. We will restrict ourselves to processes occurring 
over a finite interval of time, [0, r], and will say that a process is static if the work parameter 
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and thermal contacts are constant over the course of the process. Note that a process is 
defined without reference to the preparation of the system of interest itself. 

Having introduced the notion of a process to specify "what we do to ip" at the macroscopic 
level, let us now turn our attention to the microscopic response of the system of interest and 
reservoirs. A complete description of this response is provided by a trajectory T(t), detailing 
the (Hamiltonian) evolution of all participating degrees of freedom. We will, however, be 
interested in a less complete description, consisting of: the microscopic history of ip itself, 
and the net entropy generated, AS, over the course of the process. By the former, we mean 
a trajectory z(t) specifying the evolution of the microstate of the system of interest (the 
position and momentum of each constituent degree of freedom), from t — to t — r. By 
entropy generated, we mean the quantity 

AS = -f:^, (2) 

n=l 1 n 

where AQ n denotes the net heat absorbed by ip from the n'th reservoir, over the course 
of the process. We justify the nomenclature by noting that, at the macroscopic level of 
description, —AQ n /T n corresponds to the net change in the entropy of the n'th reservoir. 
Thus, AS can be viewed as the change in the entropy of the environment of ip (the collection 
of reservoirs), which we abbreviate to "entropy generated". (See also the definition of the 
rate of entropy production introduced in Ref . . ) 

Note that both z(i) and AS can be obtained from the complete microscopic description, 
r(t): the former, by projecting out the reservoir degrees of freedom; the latter, by using the 
initial and final conditions T(0) and T(r) to compute the net change in the internal energy 
of each reservoir. (See Eq|| below, and commentary in Section |VI|) . 

Because the system of interest interacts with the reservoirs, the microscopic evolution of ijj 
itself is not deterministic. Rather, an initial microstate determines a statistical ensemble 
of possible realizations, each characterized by a particular history z(t), and a particular 
value of entropy generated AS. This is the ensemble of realizations which we would obtain 
by endlessly repeating the same process, always initializing ip in the microstate za] the 
difference from one realization to the next arises solely from the different initial conditions 
sampled for the reservoirs. From this ensemble, let us imagine constructing the statistic 

P(z B ,AS\z A ), (3) 

which is the joint probability distribution of obtaining a final microstate z(r) = z#, and an 
entropy generated AS, conditional on the initial microstate z(0) = za- This joint, condi- 
tional probability distribution P will be the object of central interest in this paper. This is 
admittedly a somewhat peculiar quantity to investigate. No attempt will be made to moti- 
vate our interest in this statistic other than that "it works" , in the sense that consideration 
of P{zb, AS\z a ) leads to the neat result expressed by Eq|| below. 

Let us now introduce a final piece of notation. For an arbitrary process let its time- 
reversed counterpart, II - , denote the process obtained by using the same set of reservoir 
temperatures, but carrying out the protocol of Il + in reverse order (reversing the time- 
dependence of both the work parameter and the thermal contacts established and broken). 
We will, quite arbitrarily, refer to Il + as the "forward" process and II - as the "reverse" 
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process. When discussing the conditional probability P(z B , AS\za), computed for two pro- 
cesses Il + and II - related by time- reversal, the notation P + and P_ is used to distinguish 
between the two cases. 

The central result of this paper then asserts that the probability distributions P + and 
P satisfy the following relation: 

i A Cl„ N 

exp(AS/k B ), (4) 





{z B ,+AS\ 






(z%-AS\ 





where the asterisk (*) denotes a reversal of momenta: (q, p)* = (q, — p). To obtain some 
intuition for what this result says, imagine filming the evolution of the system, work param- 
eter, and reservoirs during one realization of the process n + , as the microstate of ip evolves 
from za to z B and the entropy generated is AS. Now imagine running the film backward; 
you will then see a realization of the process II - , with ip evolving from z* B to z* A , and entropy 
generation —AS". Eq.^ thus relates the conditional probability of observing one set of events 
(za — > zb, +AS) during a given process, to that of observing the time-reversal of those 
events [z B — > z* A , —AS") during the time-reversed process: it states that the ratio of these 
two probabilities is just the exponent of the entropy generated, AS, in units of k B . For a 
static thermodynamic process, we have n + = n~, and therefore we can drop the subscripts 
+ and — appearing in Eq.[|. 

Eq.fl is a hybrid result, akin both to the fluctuation theorem (through dependence on 
AS), and to a statement of detailed balance (because of the appearance of the initial and 
final microstates of ip); for this reason we refer to it as a detailed fluctuation theorem. 

Note that if AS > 0, then the conditional probability appearing in the numerator is 
greater than that in the denominator; if AS" < 0, the opposite is true. This makes intuitive 
sense: of the two scenarios, the one which remains obedient to the second law by generating 
positive entropy is more likely than its disobedient twin, by a factor exponential in the 
entropy generated. 

The proof of Eq.[| will follow directly from the assumption that evolution in the full 
phase space (including the degrees of freedom of ■0, 9\, • • • , 6 N ) is deterministic and Hamilto- 
nian. For a process II, the statistical ensemble of realizations corresponding to a particular 
initial microstate za for the system of interest is then defined operationally: it is the en- 
semble obtained by initializing ip in the microstate za, then sampling the initial conditions 
of the reservoirs iy®, ■ ■ ■ ,y%) from canonical distributions at the specified temperatures 
(Ti, • ■ ■ , T/v). Given za, the choice of (y°, ■ • • , y%) uniquely determines the subsequent evo- 
lution of all degrees of freedom, T(t). The probability distribution of obtaining a given 
realization, conditional on a given microstate za for ijj, then reduces to that of sampling the 
appropriate initial microstates of the reservoirs. 



III. DERIVATION 

To carry out the derivation of Eq.[|, we begin by introducing notation and spelling out 
assumptions, starting with the classical approximation: all quantal effects are ignored. 

The system of interest, ip, is taken to have a finite number of degrees of freedom, and 
its instantaneous microstate is described by a point z = (q, p) in the phase space of ip, 
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with the usual assignment of q to denote configurational variables, and p the associated 
momenta. At any instant in time, the internal energy of ip is given by a Hamiltonian Hf(z), 
parametrized by the current value of the work parameter A. 

Next, assume that each heat reservoir 6 n is itself a classical system with a finite number 
of degrees of freedom, whose microstate is described by a point y n in the phase space 
associated with that reservoir. We do not assume the reservoirs to be physically identical, 
so the dimensionalities of the y n 's may differ. The internal energy of the n'th reservoir is 
given by a Hamiltonian H^(y n ). 

Finally, let ^(z, y„) denote a weak coupling term between the system of interest and 
the n'th reservoir. As discussed below, thermal contact between i\) and 9 n can be established 
or broken by turning this term "on" and "off", using parameters c n (t). 

For simplicity of presentation, assume time-reversal invariance ( "no magnetic fields" ) for 
these Hamiltonian terms: 

Hf(z*) = Hf(z) , H* n (f n ) = H* n (y n ) , K\z\ y* n ) = K\z, y B ). (5) 

The vector 

r = (z,Y) = (z, yi ,..., yjv ) (6) 

specifies the instantaneous state of all degrees of freedom involved, where Y = (yi, • • • , yjv) 
denotes the collective microstate of the N reservoirs. The evolution of T(t) is taken to be 
deterministic, and governed by a Hamiltonian 

N N 

H(T,t) = Hf {t) (z) + £ H e n (y n ) + £ c n (t) K\z,y n ). (7) 

71=1 71=1 

Here X(t) denotes the time- dependence of the work parameter, and the c n (t)'s take on values 
of or 1, which can also change with time. At a given time t, if c n (t) = 1, then this indicates 
that the system of interest is in thermal contact with the n'th reservoir at that time; when 
c n (t) = 0, ip and 9 n are not in contact. (More generally, we could let the c n 's take on a 
continuous range of values, allowing the thermal contacts to be turned on and off smoothly 
rather than abruptly. This modification would have no effect on the analysis.) 

The collection {A, c } = {A, ci, • • • , cat} represents the "tool-kit" available for externally 
manipulating the system of interest. The protocol for a given process, n, is then just a 
particular prescription for doing so: it is synonymous with a specific set of functions of time, 
{A(t),c(t)}, instructing us exactly how to manipulate the work parameter and thermal 
contacts over a time interval [0, r]. This protocol uniquely specifies the time-dependence 
of the Hamiltonian function TC(T,t), since that time-dependence enters only through X(t) 
and c(t). We will use Hn(T,t) to denote the time-dependent Hamiltonian corresponding 
to a particular process n. If the protocol for a process n + is {A(t),c(t)}, then that of its 
time-reversed counterpart n~ is given by {A(r — t), c (r — t)}. 

While the time-dependence of the parameters {A, c} is controlled externally, the partici- 
pating dynamical degrees of freedom r = (z, yi, • • • , yjv) evolve under Hamilton's equations, 
as determined by Hn(T, t). Thus, initial conditions T(0) uniquely determine a trajectory 
r(£), which chronicles the microscopic history of all degrees of freedom. From this trajectory, 
as mentioned earlier, we can extract both the microscopic history of the system of interest, 
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z(t) (by projecting out the reservoir variables Y), and the net heat absorbed by if) from each 
of the reservoirs. The heat absorbed by ip from a particular reservoir is equal to the net 
decrease in the internal energy of that reservoir: 

Ag n = J Hj(y B (0))- J Hj(y n (r)). (8) 

From the AQ n 's we in turn compute the entropy generated (Eq.[2j). 

We note that, if T + (t) is a microscopic realization of a process then = r^(r— t) 

is a realization of the reverse process II - . This follows from the assumption of time- reversal 
invariance: if r+(i) satisfies Hamilton's equations for the forward process, then r_(£) will 
do so for the reverse. 

The reservoirs, as mentioned, are initially prepared at specified temperatures, T 1; • • ■ , Tjy. 
We take this to imply that their initial microstates y° = y n (0) are sampled from canonical 
ensembles. This defines the following probability distribution for the collection of initial 
reservoir conditions: 

JV 

P(Y°) = M~ x J] e*p[-H*(y°J/k B T n ], (9) 

n=l 

where M{Tx, ■ ■ ■ , T N ) is a product of partition functions. 

Finally, for a process Il + and a set of initial conditions V in the full phase space, let 

f'(r) = (s'(r),Y* + (r)) (io) 



denote the point in phase space reached after time t, and let AS + (T) denote the net entropy 
generated over the entire realization of the process (from t — to t — r). The carats 
emphasize that r^_, z*,, Y+, and AS + are viewed as functions of the initial conditions 
T. For the time-reversed process, we adopt the same notation, with an obvious change in 
subscript (r 4 ,, zl, etc.) 

All the pieces needed to derive Eq.|] are now in place. We begin with a formal expression 
for the joint, conditional probability distribution in which we are interested: 

P + (z B , AS\z A ) = J dY P (Y)6[z B - z T + (z A , Y)] • 6[AS - AS + (z A , Y)}. (11) 
Using the identity z^(z, Y) = z, we rewrite this as: 

P + (z B , AS\z A ) = J dTp(Y) ■ S[z A - z% (r)] ■ 6[z B - z T + {T)} ■ 5[AS - AS + (T)}, (12) 

where T = (z, Y). Now let T' = (z',Y') = r+(r) denote the final point in the full phase 
space, for a realization of Il + launched from initial conditions T. For a given F = (z, Y), we 
can rewrite p(Y) as: 

P(Y) = ^yP( Y ') = exp[AS + (T)/k B }p(Y'), (13) 
using Eqs.0, |l H, which leads to 
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P + (z B , AS\z A ) = e AS ' kB J dTp(Y')5[z A - z° + (T)} ■ 5[z B - z^(r)] • 5[AS - AS + {T)). (14) 

Here p(Y') is not to be interpreted as "the probability distribution of final reservoir con- 
ditions", but rather as the function p defined by Eq.|9|, evaluated at Y' = Y+(r). Since 
T' is reached from V by time evolution under the process and since we have assumed 
time-reversal invariance (Eq||), it follows that, if we reverse the final momenta and launch 
a realization of II~ from initial conditions T'*, then we will obtain the time-reversed image 
of the original realization: r^_(r'*) = [r^r*(r)]*. From this it follows that 

z*_(r'*) = 

This allows us to rewrite Eq.|14| as: 

P+(z B , AS\z A ) = e AS/kB J dTp(Y'*)5[z\ - z T _(T'*)} ■ 5[z* B - z°_ (F'*)} ■ 5{AS + AS^T'*)}, 

(16) 

where we have used the fact that p(Y') = p(Y'*) (Eqs.^J^). Finally, since the integrand is 
expressed in terms of T'*, which is an invertible function of T (defined by time evolution, 
followed by a reversal of momenta), let us change the variables of integration from T to T'*. 
The Jacobian for this change of variables is unity (by Liouville's theorem), so we simply 
replace dT by dV* in Eq.|l6|. But then we can drop the prime and asterisk altogether (since 
T'* is just a variable of integration) to get: 

P + (z B , AS\z A ) = e AS ' kB J dTp(Y)5[z\ - ¥_{Y)} ■ 5[z B - z°_(T)} ■ 6[AS + AS^T)) (17) 

= e AS / kB J dYp(Y)5[z* A - z T _(z* B ,Y)] ■ 5[AS + AS-(z* B , Y)] (18) 
= e AS/kB P4z* A ,-AS\z B ), (19) 

which is the desired result. 

The origin of the exponential term in Eq.|] can be understood informally, as follows. 
Given a "forward" realization r + (t), and its time- reversed image T_(t), e As ^ kB is the proba- 
bility distribution for sampling the reservoir initial conditions corresponding to the forward 
realization, relative to those corresponding to the reverse realization, from canonical distri- 
butions: e AS/kB = p(Y)/p(Y'*). The probability P + appearing in the numerator of Eq.0] is 
a sum of contributions from all realizations for which ip evolves from z A to z B and the en- 
tropy generated is +A5; and similarly for P_. The two sets of realizations are in one-to-one 
correspondence with each other: for every T + (t) contributing to P + there is a time- reversed 
realization T_(t) contributing to P_. Since, for every such pair of realizations, the ratio of 
probability distributions for sampling the associated initial reservoir conditions is e As ^ kB , 
the ratio of the two sums (P + to P_) is equal to this exponential. 

We end this section by pointing out that a result similar to Eq.f| can be derived for the 
statistic 

P( Zi ,z 2 ,---,zm,A5|zo) , M>1, (20) 



5 (r) 



AS.(T' 



-AS + (F). 



(15) 



S 



which is the joint probability distribution that tp will evolve through the sequence of points 
zi, z 2 , • • • , zjv/, at times ti,t 2 , ■ ■ ■ ,t M , where t m = mr/M, and that the entropy generated 
will be AS, given z(0) = z . Formally, for a process n + , 

. M 

P + (z 1 ---z M ,AS|z )= dYp(Y)5[AS-AS + (z ,Y)} ]J 5[z m - z^(z , Y)]. (21) 

J m=l 

A calculation similar to the one presented above then gives: 

P + (zi,z 2 ---z M ,+AS'|z ) 



P_(z* M _ l ---z *,-AS\z* M ) 



exp(AS/k B ). (22) 



Note that the discrete trajectory implied in the denominator (z* M Zq) is the time- 

reversed image of the one in the numerator (zo — > • ■ ■ — > Zyi). Eq.[| is just a special case, 
M — 1, of Eq.|22|. The latter remains valid as well in the opposite limit, M — > oo (with 
r fixed), in which case the entire history of ip is specified. We then write, in suggestive 
notation, 

D r„ / + \ i A cl„ /'nM 

exp(AS/fc B ), (23) 





-(*), 


+AS|z + (0)] 


P_[z_ 


-(*), 


-A5|z_(0)] 



where z_(t) = z\(t - t). 

For an isolated system (N = 0) perturbed by external forces of finite duration, we 
have AS = 0, by definition. Thus, by Eq.|2"!2|, the conditional probability distribution of 
observing the (isolated) system evolve through a given sequence of points during the process 
is equal to that of observing it to pass through the time-reversed sequence during n~. 
This probability distribution will be a product of 5-functions: either the unique trajectory 
launched from z goes through the sequence Zi, • • • ,Zm, or it does not. In this case (N = 
0), Eq.|23] is essentially equivalent to Eq.7 of Ref. | 25|| . (A technical point of difference 



is that Bochkov and Kuzovlev consider the unconditional probability of observing a given 
realization, assuming the system of interest begins in equilibrium, for both the forward and 
the reverse realization; the exponential factor which they obtain is a ratio of probabilities of 
sampling microstates of i/j itself from a given equilibrium distribution.) 



For a single heat reservoir (N = 1), Eq.^ is similar to Eq.9 of Ref. [23]. The main 



difference is that in Crooks' formulation the evolution of the system of interest is explicitly 
taken to be a Markov process, occurring in discrete steps. Here, by contrast, the microstates 
z m represent "snapshots" of ip taken at equally-spaced time intervals during continuous-time 
evolution, and in general this sequence of states cannot be viewed as a Markov chain. 

Evans and Searles Q have also derived the (transient) fluctuation theorem by comparing 
the probabilities of sampling initial conditions of pairs of finite-time trajectories, one the 
time-reversed image of the other. In their approach, the system of interest evolves under 
deterministic but non-Hamiltonian equations of motion, to model the presence of a heat 
reservoir. They find, as above, that the probability measure of a given trajectory, relative 
to that of its time-reversed twin, is the exponent of the entropy generated (where the latter 
is identified with phase space contraction). 
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IV. RELATION TO THE STEADY-STATE FLUCTUATION THEOREM 



In terms of the average entropy generation rate, a = AS/r, Eq.f| can be rewritten as 

l t P + (z f+! ,|z f ) 

T P_(Z* A , -<TT\Z* B ) 

which is reminiscent of the steady-state fluctuation theorem, Eq.|I]. However, the correspon- 
dence is not exact: Eq.|l| applies explicitly to a nonequilibrium steady state, contains the 
limit t — ► oo, and exhibits no dependence on initial and final microstates of the system of 
interest, all in contrast to Eq.[24j. In this section we pursue the relationship between the 
detailed fluctuation theorem of this paper and the steady-state fluctuation theorem. 

Rather than aiming at complete generality, we will focus on a specific physical situation 
which might exhibit a nonequilibrium steady state in the appropriate limit, with the ex- 
pectation that the line of reasoning applied here can serve as a model for other examples. 
In Fig.|I|, the system of interest is a fluid composed of particles of "type A" , inside a finite 
cylindrical container of length I. The reservoirs are fluids of "type B" particles, contained in 
two cylinders of length L abutting the ends of ip. Let denote the number of particles con- 
stituting the system of interest, and let v g — v\ = v% denote the number in either reservoir. 
Assume that the forces between particles are pairwise, unaffected by the barriers between 
the cylinders, and have a short interaction range r < I. Also assume that all particles scatter 
elastically off the container walls. 

Given this set-up, one cannot expect the system to reach a nonequilibrium steady state, 
except possibly in the limit of infinitely large reservoirs. We will now argue, quantitatively 
though not rigorously, that if ip indeed reaches a steady state in this limit, and if fluctuations 
in the entropy production in that state are characterized by finite correlation times, then 
Eq.|| (or ^4|) implies the steady-state fluctuation theorem. 



The system of interest and reservoirs depicted in Fig.|l] are governed by a Hamiltonian 
of the form given in Eq.^, with 

= E t~ + £ ^(q W , Q W ) + b.c. (25) 

i=l A i<j 
ve n [i]2 

KiYn) = E I 2 " + E *WqS?, q^ 1 ) + b.c (26) 



7i 2m B iKj 



C(^yn)=EEVkB(q [l1 ,q2 ] ), (27) 

i=l j=l 

where the index n — 1, 2 labels the reservoirs. Here, the microstates of the system of interest 
and reservoirs are denoted by 

z = (q [11 ,p [ V--,q M ,P K1 ) (28) 
y» = (qf 1 ,I* I ,-",qS» ] ,pS* ] ), (29) 

V xy represents the short-range interaction potential between particles of type x and y, and 
"b.c." denotes boundary conditions, implying elastic reflection off the walls of the containers. 
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There is no work parameter, and thermal contact between the system of interest and the 
reservoirs is always "on" (c n = 1). 

Let us now choose two temperatures 7\ and T 2 to be associated with the reservoirs 9i 
and 6*2. We can then subject the system of interest to a (static) thermodynamic process, 
by starting with ip in some initial microstate z A , sampling the initial microstates (y°, y°) 
of the reservoirs from canonical distributions at the chosen temperatures, and letting the 
entire system evolve for a time r under the Hamiltonian TC = + J2n + Y^n C*- For 
this process, we can construct the statistic P?{z Bl AS\za)- This is the joint, conditional 
probability distribution defined in Section |TJ, but with the dependence on the duration of 
the process, r, and the size of the reservoirs, to = (L, ug), explicitly stated. 

The detailed fluctuation theorem, Eq.f|, then tells us that 

P?(z B ,+AS\z A ) fAQ/ , , 

P?(z%-AS\z B ) = eMAS/kB) > (30) 

for this static process. Let us now change variables, from AS toW— AS/r, by defining 

p^{z B ,a\z A ) = P?(zb,vt\za) -t, (31) 

the joint probability distribution of observing, after a time r, a final microstate z B , and an 
average entropy generation rate a, conditional on an initial microstate z A - 

We view p^(z B ,a\zA) as a function of za, z b , and a, parametrized by the values of r, L, 
and vq. Let us now assume, first, that 

P t {z b ^\za) = lim p^(z b ,Tt\za) exists (pointwise) , (32) 

where u u — > oo" denotes the limit L, Ug — > oo, with the particle density vq/L held fixed. 
Thus, we assume that the dynamics of ip converges to a well-defined limit, as we let the 
reservoirs become infinitely large. Eq.[3(] then implies that 

l ln P?(z B , + a\zA ) W 

T p n{z* A ,-W\ Z * B ) fe B ' 1 ^ 

for any finite value of r. 

[A bit of care is needed here, since, in the limit u —>■ oo, the entropy generated becomes 
defined in terms of differences between infinite numbers (the initial and final energies of 
Q\ and 6*2). The assumption expressed by Eq.[32| states that, for any fixed a, the quantity 
p^(z B , 7t\za) converges to a particular value as the reservoirs become increasingly larger; 
roughly speaking, even though typical initial and final reservoir energies diverge in that limit, 
the energy differences AQ n do not. One can heuristically argue that this is a reasonable 
assumption, as follows. For a given particle density and temperature, there ought to be a 
characteristic "signal velocity" v with which information about the microstate of particles 
in one region of the reservoir gets propagated to other regions. If we choose L ^> vt, then 
we expect the particles at the far end of either reservoir to have negligible influence on the 
evolution of ip, hence p^(z B ,a\zA) will be unaffected by further increases in reservoir size, 
uj. When taking the limit r — > 00 below, it will be understood that the limit u — > 00 comes 
first .1 
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Let us next assume that, under the dynamics imposed by infinitely large reservoirs, ip 
evolves to a statistical steady state. Let f s (z) denote the distribution of microstates, and 
(a) the probability distribution of observing an average entropy production rate a over 
a time interval of duration r, in the steady state.0 We further assume that, in the steady 
state, fluctuations in the entropy production are characterized by a finite correlation time 
t c , so that the average entropy production rates measured over two adjacent time intervals 
of duration t c can be treated as statistically independent. Finally, let a s denote the infinite- 
time average entropy production rate (equivalently, the expectation value of the average 
entropy production rate over any finite time interval) in the steady state: 

\im p s T (a)=5(a-a s ). (34) 

Given these assumptions, we now want to justify replacing the numerator and denomi- 
nator of Eq.^3| by pf(+a) and p^(—a), respectively, in the limit r — ► oo. 



As a first step in this direction, we define 

p T (z B \z A ) = J dap^(z B ,a\z A ) (35) 
and p r (a\z A ,z B ) = p^(z B ,a\z A )/p T (z B \z A ). (36) 

(We will drop the superscript Q henceforth, with the understanding that the limit of infi- 
nite reservoirs is assumed in the remainder of this section.) The former is the probability 
distribution of observing a microstate z B at t = r, given z A at t — 0. The latter is the 
distribution of average entropy production rates a over the interval from t — to t — r, 
conditional on an initial state z A and a final state z B . Note that 

lirn p T {z B \z A ) = / 5 (zb), (37) 

by the assumption that ip evolves to a stationary steady state. 
Eq.[33] now becomes 

t p T (z A \z* B ) t p T (-a\z* B ,z A ) k B 

which again is valid for any r. By Eq.^, the first term on the left will vanish as r — > oo. 
It remains then to show that, in this limit, the numerator and denominator of the second 
term can be replaced by pf(+a) and pf(—a). It is tempting to argue that the dependence 
of p r (a\z A , z B ) on the specified initial and final microstates will vanish as r — > oo, and 
therefore 



1 Note the distinction between the use of the subscript r in the statistic (a), and its use in 
p^(z B , a\z A ). In the latter, the time interval of duration r is measured from the initial time, 
t = 0, at which the reservoir microstates are drawn from canonical distributions. In the former, 
the interval is measured starting at some moment after the steady state has been achieved. In 
both cases, the entropy generated is defined in terms of the net changes in internal energies of the 
reservoirs, over the interval in question. 
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p T (cr\z A ,z B ) -> Pt(o). (39) 

This is true in the sense that both sides of Eq.|3§] converge to the same distribution of values 
of a, namely, 5(a — a s ). However, since that limiting distribution is singular, we cannot 
simply assume that, for instance, the ratio of p T (a\z A ,z B ) to pf(cx) at a given value of a 
converges to unity as r — > oo. (In general it does not.) Justifying the above-mentioned 
replacement will therefore require some work. 

Let x be a stochastic variable denoting the time-averaged entropy production rate during 
an interval of duration t c , when the system is in the steady state. Thus, the value of x is 
a value of a sampled randomly from the distribution p£(cf). Note that (x) = a s , where 
angular brackets denote expectation value. For an interval of duration r = Kt c (where K 
is a positive integer) we then have, by our assumption of finite correlations, 

p s T (a) = (5(a-X)), (40) 

where 

2C = ^f>, (41) 
^ k=l 

and the XkS denote independent samples of the same stochastic variable. 



Eq.^0] pertains to a system already in the steady state. Let us write down a similar 
equation for p T (a\z A , z B ). For r sufficiently large, we can divide the interval [0, r] into three 
segments: initial, intermediate, and final. During the initial segment, the system relaxes to 
the steady state, and the influence of the initial state z A is felt statistically: the probability 
distribution of values of entropy produced during this segment depends on z A . During the 
intermediate segment, the system is in the steady state, and its behavior is independent 
of either z A or z B . During the final segment, the influence of the assumed final state z B 
is felt statistically. The amounts of entropy generated during each of these segments are 
statistically independent of one another. For simplicity, let us assume that the initial and 
final segments are both of duration t c , and that the total interval r = Kt c as above. Then 
we can write 

p T (a\z A ,z B ) = (5(a-Y)), (42) 

where 

Y = ^(a + b+Y^x k ), (43) 

k=l 

where a and b are stochastic variables representing the average entropy production rate 
during the initial and final segments, respectively. The dependence of these on z A and z B 
is implicit. 

Both pf(a) and p T (a\z A , z B ) have been reduced to distributions of averages of K in- 
dpendently drawn samples. In the former case, all K samples are drawn from the same 
distribution (Eq.|4"T|), corresponding to the steady state. In the latter case, K — 2 samples 
are drawn from that distribution, and the remaining two (a and b) are drawn otherwise 
(Eq.^3j). How do these two distributions compare, in the limit K — > oo (in which one would 
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expect the contributions of a and b in Eq.| 
we can write 



to become negligible)? Introducing c = a + b, 



p T (a\z A ,z B ) 



dcr](c)pf,(a'), 



(44) 



where 77(c) = (6(c — c)) is the probability distribution of values of c; r' = r — 2i c ; and 



a 



Ka-c 
K-2 



(45) 



is the entropy generation rate implied for the intermediate segment (of duration r'), if the 
rates during the initial and final segments sum to a value c, and the time-averaged rate for 
the entire interval [0, r] is a. Thus, in Eq.fO] we are integrating over all possible ways of 
splitting a total entropy AS = ar into a sum of two terms: that generated during initial and 
final segments (ct c ), and the remnant (<xV) during the intermediate, steady-state segment. 

The distribution of averages of many independently drawn samples is governed by the 
theory of large deviations [EHI], which predicts that, for a fixed value of a, 



'KI§ 



7T 



exp 



-KI(a) 



(46) 



as r, K — > 00 (t c fixed). Here, I(x) is the rate function (or entropy function) associated with 
the stochastic variable x; Jq is the second derivative of I(x), evaluated at the minimum of 
that function, x min = a s ; and the normalization factor is obtained by steepest descent. [The 
rate function is defined up to an additive constant. For convenience we have set the value 
of / to zero at x min . Eq.[46] implies that, right around that minimum, pf(w) tends toward a 
Gaussian of variance (2KIq)~ x . This is just the central limit theorem.] We can write down 
a similar result for pf,(a'), replacing K by K — 2 in Eqj4^, and a by a'. Then taking the 
ratio of the two functions and considering the limit r — > 00 ( equivalent ly, K — > 00) gives 



lim 



00 pS(o-) 



exp 



21(a) + (c - 2a) I' (a) 



where I'{x) = dl(x)/dx, and a' is given by Eq.|45|. 
Combining Eqs.^3| and we finally get 



lim 

T— >00 



p T (a\z A ,z B ) 
pS(a) 



(47) 



dcr)(c) exp 21(a) + (c — 2a)I'(a) = R(a, z A , z B 



(48) 



where the dependence of R on z A and z B enters through the implicit dependence of a and b 
(hence, c) on those microstates of ip. We see that, indeed, the ratio of the two distributions 
does not generally converge to unity. However, it does converge (by the arguments just 
presented, and assuming the integral in Eq.[2S] converges!) to a function which does not 
depend on r. Therefore we get, for the second term on the left side of Eq.|38|, 



1 p T (+(r\z A ,z B ) 
t p T (-a\z* B ,z* A ) 



t pS(-a) 



1 R(+a, z A ,z B ) 
H — in 



T 



R(-a, 



(49) 
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as r — > oo. Combining Eqs.[38| and ^9] and dropping the terms which vanish in that limit, 
we finally get 

lim - In = +v/k B , (50) 

which is the steady-state fluctuation theorem (Eq.[I|). 

While the arguments presented in this section lack mathematical rigor, they might point 
the way toward a proper derivation of Eq.[TJ from Eq.|j. An interesting question is: what 
additional assumptions are required in order for the detailed fluctuation theorem to rigor- 
ously imply the steady-state fluctuation theorem? Clearly a carefully crafted assumption 
about the existence of a steady state in the limit of infinitely large reservoirs (u — > oo) is a 
sine qua non. If we further assume exponential decay of the autocorrelation function of the 
instantaneous entropy generation rate, then perhaps the arguments advanced above could 
provide the backbone of a rigorous theorem. 

A somewhat different approach has been taken by Eckmann, Pillet, and Rey-Bellet [BO 



in their study of a chain of anharmonic oscillators coupled to two infinite heat reservoirs. 
They are able to project out the reservoir variables, and thus reduce the evolution of the 
oscillator chain (supplemented by a set of auxiliary variables) to a Markov diffusion process. 
By studying the generator of this diffusion process, they argue that their model exhibits 
entropy production in accordance with the steady-state fluctuation theorem. 



V. RELATION TO FAR-FROM-EQUILIBRIUM FREE ENERGY RESULTS 

Independently of the fluctuation theorem, another far-from-equilibrium result has been 
derived and generalized in recent years [2I-|2"7|]. Consider a system initially in thermal 
equilbrium with a heat reservoir at temperature T. Now imagine externally changing a 
work parameter from an initial value (say, A = 0) to a final value (A = 1) over a finite time, 
while keeping the system in contact with the reservoir. Once the final value of the work 
parameter has been reached, hold the work parameter fixed and let the system and reservoir 
re-equilibrate. The system thus begins and ends in equilibrium states, corresponding to 
A = and A = 1, but at intermediate times is driven out of equilibrium by the finite-rate 
variation of the work parameter. (The assumption that the system ends in equilibrium 
is not necessary, but makes for a more pleasant presentation.) Now imagine repeating this 
process infinitely many times, always following the same protocol for varying A, and carefully 
measuring the external work W performed on the system during each realization. Then the 
distribution of values of W obtained from this ensemble of realizations obeys the following 
equality, regardless of how gently or violently the parameter was switched from to 1: 



[exp(-/3W)) = exp(-/3AF) , (3 = l/k B T, (51) 

where (• • •) denotes an average over the ensemble of realizations, 

AF = -(3- 1 ln(Z 1 /Z ) (52) 

is the free energy difference between the initial and final equilibrium states of the system, 
and the Z's are the associated partition functions: 
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Z\ = J dz exp[— 



(53) 



Eq.|51] was originally derived using a Hamiltonian formulation [2]J , but has also been shown 
to be valid under explicitly non-Hamiltonian evolution - including the Nose-Hoover ther- 
mostating scheme pl| , |22| , Markov- chain dynamics p2]-|2"4]| , and Langevin evolution |22| , p5 | - 
and has been generalized to a wider class of thermodynamic processes [18.23], 26. 27 . 



[Eq.|5T] can be viewed as an extension, to irreversible processes, of the relation W = 
AF, which holds for a reversible, isothermal process from one equilibrium state to another. 
Furthermore, it immediately implies the inequality (W) > AF, in agreement with the 
second law of thermodynamics, and places an exponentially decaying upper bound on the 
probability of observing finite-size violations of the second law | 26| : 



Prob(iy <AF-X) < e~ x/kBT .} 



(54) 



Let us now derive Eq.|5T] from the detailed fluctuation theorem obtained in the present 



paper, following a line of reasoning similar to that presented by Crooks [£3| for the case of 
Markov evolution. 

Let Il + be a process involving a system of interest, if), a single reservoir, 9 (prepared at 
temperature T), and a work parameter A which is varied from A(0) = to A(r) = 1. During 
a single realization of this process, the work W performed on if) is given by 



W = AE - AQ, 



(55) 



where AE is the net change in the internal energy of if), and AQ (Eq.|8|) is the heat absorbed 
by if) from the reservoir. Following the notation of previous sections, let za and z B denote 
the initial and final microstates of if), and AS" the entropy generated, for a given realization. 
Since AQ = —T ■ AS (Eq.|^), the value of W can be expressed as a function of z A , %b, and 
AS: 



W(z A , z B , AS) = Hf =1 (z B ) - Hf =0 (z A ) + T ■ AS. 



(56) 



Assuming a canonical distribution of initial conditions, we can construct the ensemble av- 
erage of exp(— PW) as follows: 



exp(-pW) 



J dzAY e M-PHt (z A )] J dz B J d(AS)P + (z B ,AS\z A )exp(-pW). (57) 



Invoking Eqs.[| and |56| allows us to rewrite this as: 



exp(-pW) 



±-Jdz A ex P {-pHf =1 (z B )] J dz B J d{AS)P4z* A ,-AS\z B ) 
tJt / dz B exp[-pHf =1 (z B )} 
PAF), 



Zi 

— = exp 



(58) 
(59) 
(60) 



as promised. 

Note that Eq.8 of Ref. [^5] can be viewed as a special case of Eq.^I] above, for the situation 
in which the initial and final Hamiltonian functions are the same: H\ =0 (z) = H\ = i(z), hence 
the free energy difference is identically zero: AF = 0. 
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VI. DISCUSSION 



The motivation for this paper has been a belief that one ought to be able to derive the 
fluctuation theorem - or something like it - within the framework of traditional statistical 
mechanics; that is, by contemplating a system of interest interacting with a thermal envi- 
ronment. The central result of this exercise, Eq.f|, is a detailed fluctuation theorem, valid 
for finite times and made without reference to a steady state. Given the definitions and 
assumptions made in this paper, Eq.[| is identically true. We now briefly address a number 
of issues related to this result. 

The first involves the definition of AS. Specifying what is meant by the entropy gener- 
ated during a single realization of a given process is inherently problematic, since entropy, 
in statistical mechanics, is ordinarily associated with an ensemble of microstates. Eq.^| must 
therefore be regarded as constituting a particular choice of definition of AS. This choice, 
however, is not entirely arbitrary, but rather (as indicated in Section [TJ) guided by macro- 
scopic thermodynamics, where the entropy increase of a thermal environment is identified 
with the heat, per unit temperature, absorbed by that environment. 

There is another apparently troubling feature of the definition of entropy generated: to 
compute AS, it seems we must know the exact initial and final microstates of each reservoir 
(Eq.^). This is extremely unsatisfying, as it conflicts with the usual notion of a thermal 
environment as a huge collection of unmonitored (and uninteresting) degrees of freedom 
"out there". However, one can infer the AQ n values by monitoring the evolution of only 
those environmental degrees of freedom which are at any moment interacting (exchanging 
energy) with the system of interest. Therefore if, due to short-range interaction forces, the 
exchange of energy between if) and the #'s occurs locally - say, at an interface - then AS 
can be computed by knowing only what goes on in the immediate vicinity of the system 
of interest (e.g. within boundary layers of width r in Fig.|Tj) , without explicit knowledge of 
initial and final reservoir energies. Thus, while Eq.|8| is indisputably useful as a device in the 
derivation of the detailed fluctuation theorem, that final result is really a statement about if) 
and the heat fluxes into and out of if), rather than one about if) and initial and final reservoir 
energies. 

Finally, there is a bit of arbitrariness even in the definition of the heat absorbed by a given 
reservoir (Eq.|8]), owing to the small but finite interaction energy h- m t. As with Eq.|2|, this 
definition represents a particular choice, but again this choice is consistent with macroscopic 
thermodynamics. 

The derivation presented in Section [TTT| explicitly assumes that the reservoir degrees 
of freedom are initially sampled canonically (Eq.||). The result itself, however, might not 
depend as strongly on this assumption as the derivation suggests. For macroscopically large 
reservoirs, Eq.£| ought to remain valid, at least to an excellent approximation, if the initial 
reservoir conditions are sampled from rmcrocanonical, rather than canonical, distributions. 
The argument for this is similar to the usual one for the equivalence of microcanonical 
and canonical averages in the thermodynamic limit, and goes roughly as follows. Imagine 
constructing a joint, conditional probability distribution 

P(z B ,AS\z A ), (61) 

defined in the same way as P{zb, AS\za), but with reservoir initial conditions sampled from 
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microcanonical distributions. In this case the temperatures T n appearing in the definition 
of AS are the "microcanonical temperatures" of the heat reservoirs: 

{k B TY l = — In/ dy5[E - H e (y)} . (62) 

P depends on the set of initial reservoir energies, just as P depends on the initial reservoir 
temperatures. Explicitly, we can write 

P = P^ N (z B ,AS\z A ) , P = P T ^ T *(z B ,AS\z A ), (63) 

where e n denotes the known initial energy per particle (alternatively, per degree of freedom) 
of the n'th reservoir: e n = E n /i/ n , where E n is the initial energy of, and v n the number of 
particles constituting, the n'th reservoir. Since the u n 's are fixed, the initial microcanonical 
ensemble of each reservoir is uniquely specified by the value of e n . Now, P Tl "' Tjv can be 
expressed as a weighted average of p ei " ,e N; 



N 



(z B ,AS\z A ) 



.n=l 



n ^n(Cn) T n 



■)ei---e N 



[z B ,AS\z A ), (64) 



where w n (e n ;T n ) is the statistical weight of the microcanonical ensemble at energy-per- 
particle e n , within the canonical ensemble at temperature T n , for the n'th reservoir. | In the 
thermodynamic limit of arbitrarily large reservoirs [y n — » oo, with extensive and intensive 
quantities scaled appropriately), w n (e n ;T n ) becomes peaked arbitrarily sharply around the 
value e n (T n ) whose corresponding "microcanonical temperature" is equal to T n . Assuming 
as in Section [TV] that P converges to a well-defined function of z A , z B , and AS", we will 
therefore get, in the thermodynamic limit, 

P Ti - Tn (z b , AS\z a ) = P e ^-^ T »\z B ,AS\z A ), (65) 

resulting in a microcanonical detailed fluctuation theorem. 

More generally, we expect Eq.|] to remain valid, provided that each reservoir is prepared 
in what would be characterized at the macroscopic level as a state of thermodynamic equilib- 
rium (regardless of whether the method of preparation truly yields a canonical distribution 
of microstates when carried out repeatedly). This reflects a strong prejudice that the canon- 
ical ensemble should be viewed primarily as a computational convenience, and ought not 
to be taken too seriously as characterizing the "true" statistical distribution of microstates 
of entire macroscopic bodies. Of course, all this presupposes macroscopically large heat 
reservoirs; for microscopic "reservoirs", the detailed fluctuation theorem still holds, but its 
validity then depends on a literal interpretation of Eq.^. 

Another issue involves the assumption of time-reversal invariance, Eq|| While this 
assumption was made for convenience, it is straightforward to generalize the analysis to the 
situation in which (possibly time-dependent) magnetic fields are present. In that case, given 



2 Formally, w(e;T) oc e vt / k B T J dy5[ue — H e (y)], with the subscript n suppressed. The normal- 
ization is chosen so that J dew = 1. 
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a process its time-reversed counterpart II~ is obtained by carrying out the protocol 
in reverse order, while also reversing all magnetic fields: B(t) — > — B(r — t). With this 
modification, Eq.[| remains valid (see also Refs. |T8| , |28| , p9| ) . 

The derivation of the detailed fluctuation theorem presented in this paper is admittedly 
not as "clean" as in previous works p|^i9|, where the (deterministic or stochastic) thermo- 
stating is accomplished without the explicit introduction of reservoir degrees of freedom. 
For instance, the present treatment forces us to consider the unphysical limit of infinite 
reservoirs; caveats need to be made about ignoring interaction energies; the time t = is 
privileged (since that is when the reservoir microstates are sampled canonically) ; and so 
forth. There is some consolation, however, in knowing that these messy issues are likely to 
arise in any laboratory setting, where real thermal environments and finite times of obser- 
vation are an inherent part of the game. 

Nose-Hoover-type thermostating schemes - employing one or a handful of "reservoir" 
degrees of freedom (and non-Hamiltonian equations of motion) - might offer an interesting 
middle ground between the deterministic thermostats of Refs. [0-0 and the approach taken 
here. In the original Nose-Hoover scheme, the reservoir degree of freedom (() is initially 
sampled from a Gaussian distribution. Therefore, given an appropriate definition of AS, it 
would be straightforward to define a joint, conditional probability distribution P(z B , AS\za), 
as in this paper, basically replacing the canonical distribution of initial reservoir conditions 
in Eq.[Tl| by the Gaussian distribution of initial values of (. It would be interesting to see 
whether a detailed fluctuation theorem then follows. If so, this approach might lead (by 
arguments along the lines of Section [TV]) to a Nose-Hoover steady-state fluctuation theorem. 
Presumably some chaoticity assumption would still be required to make this result rigorous, 
but at least there would be no need to worry about infinitely large reservoirs! 

Finally, it would be very nice to come up with a laboratory experiment to test the main 
result derived in this paper. The system of interest in such an experiment would doubtless 
have to have very few degrees of freedom (ideally, only one), in order to collect data with 
sufficiently good statistics in a reasonable amount of time. Furthermore, one would want a 
process during which the typical entropy generated is not much greater than fc#; otherwise, 
prohibitively many realizations would be needed before observing a single one for which 
AS* < 0. In this respect, the fact that Eq.|] is valid for finite durations r is helpful. 
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FIGURES 

FIG. 1. Three interacting fluids. See text for details. 
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